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Abstract 

In the framework of the game-theoretic probabihty of Shafer and Vovk (2001) 
it is of basic importance to construct an exphcit strategy weakly forcing the strong 
law of large numbers (SLLN) in the bounded forecasting game. We present a simple 
finite-memory strategy based on the past average of Reality's moves, which weakly 
forces the strong law of large numbers with the convergence rate of 0(y^logn/n). 
Our proof is very simple compared to a corresponding measure-theoretic result of 
Azuma (1967) on bounded martingale differences and this illustrates effectiveness 
of game-theoretic approach. We also discuss one-sided protocols and extension of 
results to linear protocols in general dimension. 

Keywords and phrases: Azuma-Hoeffding-Bennett inequality, capital process, game- 
theoretic probability, large deviation. 



1 Introduction 

The book by Shafer and Vovk (2001) established the whole new field of game-theoretic 
probability and finance. Their framework provides an attractive alternative foundation of 
probability theory. Compared to the conventional measure theoretic probability, the game 
theoretic probability treats the sets of measure zero in a very explicit way when proving 
various probabilistic laws, such as the strong law of large numbers. In a game-theoretic 
proof, we can explicitly describe the behavior of the paths on a set of measure zero, 
whereas in measure-theoretic proofs the sets of measure zero are often simply ignored. 
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This feature of game-theoretic probabihty is well illustrated in the explicit construction 
of Skeptic's strategy forcing SLLN in Chapter 3 of Shafer and Vovk (2001). 

However the strategy given in Chapter 3 of Shafer and Vovk (2001), which we call 
a mixture e-strategy in this paper, is not yet satisfactory, in the sense that it requires 
combination of infinite number of "accounts" and it needs to keep all the past moves of 
Reality in memory. We summarize their construction in Appendix in a somewhat more 
general form than in Chapter 3 of Shafer and Vovk (2001). In fact in Section 3.5 of their 
book, Shafer and Vovk pose the question of required memory for strategies forcing SLLN. 

In this paper we prove that a very simple single strategy, based only on the past 
average of Reality's moves is weakly forcing SLLN. Furthermore it weakly forces SLLN 
with the convergence rate of 0{^y\og n/n). In this sense, our result is a substantial 
improvement over the mixture e-strategy of Shafer and Vovk. Since e-strategies are used as 
essential building blocks for the "defensive forecasting" (Qlj), the performance of defensive 
forecasting might be improved by incorporating our simple strategy. 

Our thinking was very much influenced by the detailed analysis by Takeuchi (P] and 
Chapter 5 of |H1) of the optimum strategy of Skeptic in the games, which are favorable 
for Skeptic. We should also mention that the intuition behind our strategy is already 
discussed several times throughout the book by Shafer and Vovk (see e.g. Section 5.2). 
Our contribution is in proving that the strategy based on the past average of Reality's 
moves is actually weakly forcing SLLN. 

In this paper we only consider weakly forcing by a strategy. A strategy weakly forcing 
an event E can be transformed to a strategy forcing E as in Lemma 3.1 of Shafer and 
Vovk (2001). We do not present anything new for this step of the argument. 

The organization of this paper is as follows. In Section |21 we formulate the bounded 
forecasting game and motivate the strategy based on the past average of Reality's moves 
as an approximately optimum e-strategy. In Section |21 we prove that our strategy is 
weakly forcing SLLN with the convergence rate of 0{\J\og n/n). In Section |3] we consider 
one-sided protocol and prove that one-sided version of our strategy weakly forces one- 
sided SLLN with the same order. In Section El we treat a multivariate extension to linear 
protocols. In Appendix we give a summary of the mixture e-strategy in Chapter 3 of 
Shafer and Vovk (2001). 

2 Approximately optimum single e-strategy for the 
bounded forecasting game 

Consider the bounded forecasting game in Section 3.2 of Shafer and Vovk (2001). 

Bounded Forecasting Game 
Protocol: 
/Co := 1. 

FORn = 1,2,...: 

Skeptic announces M„ G M. 
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Reality announces x„ G [—1,1]. 
/C„ := /C„_i + MnXn- 
END FOR 

For a fixed e, |e| < 1, the e-strategy sets M„ = e/C„_i. Under this strategy Skeptic's 
capital process /C„ is written as /C„ = Hj'Lill + ^^«) 

n 

log/C„ = ^log(l + exi). 

1=1 

For sufficiently small |e|, log/Cri is approximated as 

n 1 ^ 

log ICn^e^Xi- -e^ X ■ . 
The right-hand side is maximized by taking 

En 
_ i=l 

In particular in the fair-coin game, where Xn is restricted as x„ = ±1, approximately 
optimum e is given as 




Actually, as shown by Takeuchi ([Ij), it is easy to check that e = x„ exactly maximizes 
nr=i(-'- + ^-^i) f^'^ ^^^^ °f fair-coin game. Recently Kumon, Takemura and Takeuchi 
(2005) give a detailed analysis of Bayesian strategies for the biased-coin games, which 
include the strateg special case. 

Of course, the above approximately optimum e is chosen in hindsight, i.e., we can 
choose optimum e after seeing the moves xi, . . . ,Xn- However it suggests to choose M„ 
based on the past average Xn-i of Reality's moves. Therefore consider a strategy V = T"^ 



M„ = ca;„_i/C„„i. (1) 

In the next section we prove that for < c < 1/2 this strategy is weakly forcing SLLN. 
The restriction 0<c< 1/2 is just for convenience for the proof and in Kumon, Takemura 
and Takeuchi (2005) we consider c = 1 for biased-coin games. 

Compared to a single fixed e-strategy M„ = eldn-i or the mixture e-strategy in Chapter 
3 of Shafer and Vovk (2001), letting e = cXn-i depend on Xn-i seems to be reasonable 
from the viewpoint of effectiveness of Skeptic's strategy. The basic reason is that 
deviates more from the origin. Skeptic should try to exploit this bias in Reality's moves by 
betting a larger amount. Clearly this reasoning is shaky because for each round Skeptic 
has to move first and Reality can decide her move after seeing Skeptic's move. However 
in the next section we show that the strategy in (0) is indeed weakly forcing SLLN with 
the convergence rate of 0{^y\ogn/n). 
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3 Weakly forcing SLLN by past averages 

In this section we prove the following result. 

Theorem 3.1 In the bounded forecasting game, if Skeptic uses the strategy (OP with 
< c < 1/2, then limsup„/C„ = oo for each path ^ = xiX2 ■ ■ ■ of Reality's moves 
such that 

limsup^^55i>l- (2) 
n V log n 

This theorem states that the strategy weakly forces that Xn converges to with 
the convergence rate of 0( A/log n/n). Therefore it is much stronger than the mixture 
e-strategy in Chapter 3 of Shafer and Vovk (2001), which only forces convergence to 0. 
A corresponding measure theoretic result was stated in Theorem 1 of Azuma (1967) as 
discussed in Remark 13.11 at the end of this section. The rest of this section is devoted to 
a proof of Theorem 13.11 

By comparing 1,1/2,1/3,..., and the integral of 1/x we have 

\og{n + 1) = / -dx <l + - + 77 + -- - + -<l + / -dx = 1 + hgn. 
Ji X 2 3 n X 

Next, by summing up the term 

1 1 1 



from = i to n, we have 



or 



{k-l)k k-1 k 

^ I _ I I .3. 

^ (k-l)k i-1 n ^ ^ 

k=i 

1 1 1 

i-1 {k-l)k n' 



Now consider the sum 



i=2 i=2 ^ ' 

When we expand the right-hand side, the coefficient of the term XjXk-, j < k, is given by 
f I 1 1 \ /II 

2 X — + — 7T + --- + 7 7T- =2 X 



{k-l)k k{k + l) {n-l)nj \k - 1 n 

We now consider the coefficient of In (0]) we have the sum from i = 2 and we need to 
treat Xi separately. The coefficient of is 1 — 1/n from Q. For j > 2, the coefficient of 
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x'j is given by — 1) — as in the case of the cross terms. Therefore 

i=2 l<i<«<'" «=2 

o \ — ^ ^ ^ \ ^ 2 \ ^ 2 \ — ^ 

n " 1 



j=2 1=2 



Write Xo = 0. Then the first sum on the right-hand side can be written from i = 1. Under 
this notational convention (jSj) is rewritten as 

n ^ n . ^ " 1 

y: x.-ix. = - -^^x\ +1^1-- (x\ + Y — • (6) 



1=1 i=2 



Now the capital process /C„ = /C^ of ((T)) is written as 

n 



i=l 



As in Chapter 3 of Shafer and Vovk (2001) we use 

log(l + t) > t-t^ N < 1/2. 
Then for 0<c< 1/2 we have 

n 

log;C„ = ^log(l + CXi_iXi) 
i=l 

n n 
^ \^ - _ 2 \ ^ -2 2 

i=l i=l 

and under the restriction |a;„| < l,Vn, we can further bound log/C„ from below as 

n n 

log /C„ > c ^ 

Y^lv (7) 

i=l i=l 
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By considering the restriction < 1, (0) is bounded from below as 

n ^ n . 1 " 1 

1 " ' n 1 

1 " n 1 

^ 2 5Z^^' + |^"-2(2 + ^°s(''~^)) 

1 " n 1 

i=l 

Since c < 1/2, substituting this into ((Zj) yields 

1 " 

log/C„ > c(^--c)E^i-i + c^^^-^(3 + log(n-l)) 



i=l 

> c-x^ --(3 + log(n-l)) 

> -inxi — logn) — -c 
- 2^ " '2 

c [ nxl \ 3 

= - log n 1 c. 

2 ^ Vlog^ / 2 



Now if lim sup„ ^/n\xn\/ \/\ogn > 1, then lim sup„ log /C„ = +oo because logra | oo. 
This proves the theorem. 

Remark 3.1 In the framework of the conventional measure theoretic probability, a strong 
law of large numbers analogous to Theorem 3.1 can be proved using Azuma-Hoeff ding- 
Bennett inequality (Appendix A.l of Vovk, Gammerman and Shafer (2005), Section 2.4 
of Dembo and Zeitouni (1998), Azuma (1967), Hoeffding (1963), Bennett (1962)). Let 
Xi, X2, ... be a sequence of martingale differences such that |X„ | < 1, Vn. Then for any 
e > 

Pi\Xn\ > e) < 2exp(-neV2). 
Fix an arbitrary a > 1/2. Then for any e > 

E^d^nl > e(logn)7v/^) < ^exp(-^(logn)2-) < 00. 

n n 

Therefore by Borel-Cantelli y/n\Xj\ / {\ogn)^ — >• almost surely. Actually Theorem 1 of 
Azuma (1967) states the following stronger result 

limsup < v2 a.s. (8) 

n^oo V log 
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Although our Theorem Vj . 1\ is better in the constant factor of \/2, Azuma's result (0j and 
our result (0j are virtually the same. However we want to emphasize that our game 
theoretic proof requires much less mathematical background than the measure theoretic 
proof. Also see the factor of a/3/2 in the one-sided version of our result in Theorem \4.1\ 
below. 

4 One-sided protocol 

In this section we consider one-sided bounded forecasting game where M„ is restricted to 
be nonnegative (M^ > 0), i.e. Skeptic is only allowed to buy tickets. We also consider the 
restriction M„ < 0. In Chapter 3 of Shaver and Vovk, weak forcing of SLLN is proved by 
combining positive and negative one-sided strategies, whereas in the previous section we 
proved that a single strategy V = weakly forces SLLN. Therefore it is of interest to 
investigate whether one-sided version of our strategy weakly forces one-sided SLLN. We 
adopt the same notations as Section 5 of Kumon, Takemura and Takeuchi (2005), where 
one-sided protocols for biased-coin games are studied. 

For the positive one-sided case consider the strategy with 

Mn = cx+_i/C„_i, = max(x„_i, 0). 

Similarly we consider negative one-sided strategy with M„ = — ca;^_^/C„_i, x~_i = 
max(— 0). 

For these protocols we have the following theorem. 

Theorem 4.1 // Skeptic uses the strategy with < c < 1/2, then limsup„/C„ = oo 
for each path ^ = X1X2 ... of Reality's moves such that 

y \fnxn [S 

hm sup > \i- 

n A/logn V 2 

Similarly if Skeptic uses the strategy with < c < 1/2, then limsup„ /C„ = 00 for each 
path ^ = X1X2 ■ ■ ■ of Reality's moves such that liminf„ \fnxnl \/logn < —^'ij^. 

The rest of this section is devoted to a proof of this theorem for . If x„ is eventually 
all nonnegative, then the behavior of the capital process /C^ and are asymptotically 
equivalent except for a constant factor reflecting some initial segment of Reality's path 
^. Then the theorem follows from Theorem 13.11 On the other hand if Xn is eventually 
negative, then stays constant and Theorem 14.11 holds trivially. Therefore we only 
need to consider the case that x„ changes sign infinitely often. Note that at time n when 
Xn changes the sign, the overshoot is bounded as 



We consider capital process after a sufficiently large time no such that — 0, and 
proceed to divide the sequence into the following two types of blocks. For uq < k < 
I — 1, consider a block {k, . . . ,1 — 1}. We call it a nonnegative block if 

Xk-i <0,Xk> 0, Xk+i > 0, . . . , >0,xi< 0. 

Similarly we call it a negative block if 

Xk-i > 0, Xk < 0, Xk+i < 0, . . . , xi-i <0,xi> 0. 

By definition, negative and nonnegative blocks are alternating. 
For a nonnegative block 



i=fc+l 

whereas for a negative block ICf^ = /C^^ . Taking the logarithm of we have 
log^r^ - log^r^ = X] log(l + cxi_ia;i) 

i=k+l 

I I 

^ \^ - _ 2 \ ^ -2 2 

^ C ^ ^ Xi—iXi C ^ ^ X^_iX^ 

i=k+l i=k+l 
I I 

> C ^ Xi-iXi - ^ X^i-l- 



i=k+l i=k+l 



From (jnj it follows 

z , I 



E_l \ ^ ^ -2,^-2 ^ -2 1 \ ^ 1 
=A;+1 i=fc+l i=fc+l 

1 Z 2 1 1 /^l 1 ^ 

> - > xf + log - . 

- 2 ^ t-1 ' 2k 2\k ^ k 

i=k+l ^ ' 



In the above, we used the approximation formula 



^ , dx \ n 1 

+ -</ — + — = log — + — . 



m m + 1 n x m mm 

Thus we obtain 

log/cr-iog/cr >— -^log^. (10) 

Now starting at uq, we consider adding the right-hand side of (|T0|) for nonnegative 
blocks and = log ICf^ — log /C^^ for negative blocks. Then after passing sufficiently 
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many blocks, log JCf^ — log /C^^ behave as (fTUI) during half number of the entire blocks. 
Therefore at the beginning Uk of the last nonnegative block, we have 

log/C;^ -log/C;, >--log— --log— + 0(1) = -— log— + o(l). (11) 

To finish the proof of Theorem \4.1\ let be in a middle of the last nonnegative block 
{uk, . . . ni^i}. Then as above, we have 

log jcr - log < > - ^ - 1 log (12) 

Adding ^ and ^ we have 

log^r^ -log^C - Y^n- 2^°S^-^lognfc + — logno + o(l). 
Noting that = 0{n), we derive 

log > f - I logn + 0(1) = ^ log^ - + 0(1). 

This completes the proof of Theorem 14.11 



5 Multivariate linear protocol 

In this section we generalize Theorem 13.11 to multivariate linear protocols. See Section 3 
of Vovk, Nouretdinov, Takemura and Shafer (2005) ^] and Section 6 of Takemura and 
Suzuki (2005) [7j for discussions of linear protocols. Since the following generalization 
works for any dimension, including the case of infinite dimension, we assume that Skeptic 
and Reality choose elements from a Hilbert space H. The inner product of x,y & H is 
denoted hj x ■ y and the norm of x G if denoted by ||a;|| = {x ■ x)^!"^ . Actually we do not 
specifically use properties of infinite dimensional space and readers may just think of H 
as a finite dimensional Euclidean space R'". For example spectral resolution below just 
corresponds to the spectral decomposition of a nonnegative definite matrix. 

Let X d H denote the move space of Reality, and assume that X is bounded. Then 
by rescaling we can say without loss of generality that X is contained in the unit ball 

X (l{x^H\ ||x|| < 1}. 

In this case the closed convex hull co(A:') of X is contained in the unit ball. As in [Zj we 
also assume that the origin belongs to co(A:'). Note also that the average x„ of Reality's 
moves always belongs to co(A:') and hence ||xn|| ^ 1- In order to be clear, we write out 
our game for multivariate linear protocol. 
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Bounded Linear Protocol Game in General Dimension 
Protocol: 
/Co := 1. 

FORn = 1,2,...: 

Skeptic announces M„ G H. 
Reality announces x„ G A". 

END FOR 

As a natural multivariate generalization of the strategy given by (^, we consider 
the strategy V = 

Mn = AXn-lJCn-l, (13) 

where A is a self-adjoint operator in H. Then A has the spectral resolution 

/oo 
XE{dX), (14) 
-oo 

where E denotes the real spectral measure of A, or the resolution of the identity corre- 
sponding to A. Let <7{A) denote the spectrum of A (i.e. the support of E) and let 

Co = inf{A I A G cr{A)}, Ci = sup{A | A G a{A)}. 

In the finite dimensional case, Cq and Ci correspond to the smallest and the largest eigen- 
value of the matrix A, respectively. 

Now we have the following generalization of Theorem 13.11 

Theorem 5.1 In the bounded linear protocol game in general dimension, if Skeptic uses 
the strategy / f73|) with < co < ci < 1/2. Then limsup„/C„ = oo for each path ^ = 
X1X2 ... of Reality 's moves such that 

hmsup — 1=- > . — . 
n vlogn V Co 

Proof: In the expression 

n 

ICn = Yl{l + Ax^^i-x,), (15) 



we have 



with 



i=l 



Axi_i ■Xi= X{E{dX)xi_i ■ Xi) = yi_i ■ yt, (16) 

J CO 



Vi-i = / y/XE{dX)xi^i, yi= y/XE{dX)xi. 

J CO J CO 
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By the Schwarz's inequality, 

, „_ _ 1 

\AXn^l-Xi\< \\yi-l\\\\yi\\ < Ci||Xi_i||||x,;|| < -. 

Hence as in ((7j), we can bound log/C„ from below as 

n n 

log^n > ^Vi-l -Vi-ci^ • (17) 

1=1 i=l 

The first term also can be expressed as in and it is bounded from below as follows. 

n ^ n . T n 

_ I o rrt I / I ^ 



i=l 1=2 1=2 

i=l 

Combining (fT7|) and (fTH|) . we have 

log/C„ > (- - ci) ll^-iP + - |(3 + log(n - 1)) 



>^l|ynf -|(3 + log(n-l)) 

^ ^11- l|2 1 3 



-logn --Cl. (19) 



It follows that if lim sup„ v^lbnll/Vci logn > 1, then lim sup„ log /C„ = +oo. Now the 
theorem follows from Co||xn|p < ||yn|P- D 



Note that 



II - ||2 ^ II - ||2 ^ II - l|2 



and the equalities hold if and only if A is a scalar multiplication operator A = cE{dX). 

Remark 5.1 Suppose that {Am} is a sequence of positive definite degenerate self-adjoint 
operators with finite dimensional ranges Ra^ (H) ^ Ra^+i {H) ■ ■ ■ , and with the supports 
(ranges of eigenvalues) a{Am) ^ a{Am+i) ■ ■ ■ C (0,1/2]. ^4/50 suppose that A^o is a 
compact operator with infinite dimensional range Ra^{H) C H, and A^ is obtained in 
the limit A^ —>■ A^q, m oo. Then co(Am) cq{Aoo) = 0, m ^ oo, so that in Theorem 
15. it ^y Ci{Am) / Co{Am) a/ci(v4oo)/co(Aoo) = oo, implying that the strategy 'P-^°° cannot 
weakly force SLLN with any rate. This phenomenon reflects one feature that the dimension 
of Skeptic 's move space is related to the effective weakly force of his strategy. It is a subject 
we will treat in the forthcoming paper. 
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A Summary of mixture e-strategy in Chapter 3 of 
Shafer and Vovk (2001) 

Here we summarize the mixture e-strategy in Chapter 3 of Shafer and Vovk (2001) for 
the bounded forecasting game in such a way that its resource requirement (computational 
time and memory) becomes exphcit. 

For a single fixed e-strategy 7^^, which sets M„ = eJCn-i, the capital process is given 
as ]C^\xi . . .Xn) — nr=i(l + ^-^i)- Shafer and Vovk combine for many values of e. 
Let l/2>ei>e2>--->0bea sequence of positive numbers converging to 0. Write 
e_fc = — efe, k = 1,2, . . . . Furthermore let {pi}i=o,±i,±2,... be a probability distribution on 
the set of integers Z, such that Pq = and p_k = Pk (symmetric). Actually pk is the initial 
amount (out of 1 dollar) put into the account with the strategy P^*, k = ±1, ±2, .... For 
example we could take 

6^=2^, Pk^^, k^±l,±2,..., (20) 

as is done in Chapter 3 of Shafer and Vovk (2001). However it is more convenient here to 
leave ek and pk to be general. Then the mixture strategy weakly forcing SLLN is given by 
the weighted average of the strategies V^'', k — ±1, ±2, . . . , with respect to the weights 
{Pk}k=o,±i,±2,..., namely 

oo 

k = — OD 

Consider the value M* of V*. It is written as 

oo n—1 

K= Pk^kY[{l + ekXi). 

k=—oo i=l 

Now introduce the elementary symmetric functions e„,o, ^n,i, ■ ■ ■ , ^n,n of the numbers 
Xi, . . . , Xji as 

n n 

i=l l<i<j<n i=l 

Recall that the set of values {xi, . . . , x„} and the set of values {e„.i, .... e„,„} are in one- 
to-one relationship. Therefore computing all the values of the elementary symmetric func- 
tions of {xi, . . . , Xn} is computationally equivalent to keep all the values of {xi, . . . , Xn}- 
Using elementary symmetric functions, M* is written as 

CO n—1 n—1 oo 

K= Yp^^H "^"'r^-i, = J2 ^"-1.^ E p'^'i'''- (21) 

A;=— oo 1=0 i=0 k=—oo 

Let F denote the discrete probability distribution on [—1/2, 1/2] with 

F{{ek})=Pk, k = ±l,±2,..., 
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and let 

-1/2 

fc=— oo 



fc=-oo -^-1/2 

denote the m-th moment of F. Then fj2H) is written as 

n-1 

M: = ^/i,+ie„_i,,. (22) 



j=0 



At this point it becomes clear that we can take an arbitrary probability distribution 
F on [—1/2, 1/2] provided that F is not degenerate at and is the point of support, 
i.e., for all e > 

F(e) -F(-e) > 0. 



M* in ()22p for such an F is a strategy weakly forcing SLLN. Now the simplest F seems 
to be the uniform distribution on [—1/2,1/2]. Actually (j2Uj) is in a sense close to the 
uniform distribution. Then 



1/2 



m : odd. 



In this case there is virtually no computational resource is needed to compute /Xm, since it 
is explicitly given. Furthermore the strategy weakly forcing SLLN based on the uniform 
distribution is given by 



n-1 ^ ^ 



. i + 2 2 -^+1 

z— 

:odd 



^'n— l,i • 



In order to compute the M* we need all the values of the elementary symmetric functions 
6n— 1,1; ^ 1, . . . , 72. 1, which is equivalent to keeping all the values of {xi, . . . , Xn-i} as 
discussed above. Therefore the mixture e-strategy needs a memory of size proportional 
to n at time n, whereas our strategy in only needs to keep track of the values of x„_i 
and /C„_i. 
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